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Abstract 

Based on stochastic curvilinear integrals in the Cairoli-Walsh sense 
and in the Ito-Udriste sense, we develop an original theory regarding the 
multitime stochastic differential systems. The first group of the original 
results refer to the complete integrable stochastic differential systems, the 
path independent stochastic curvilinear integral, the Ito-Udriste stochas- 
tic calculus rules, examples of path independent processes, and volumetric 
processes. The second group of original results include the multitime Ito- 
Udriste product formula, first stochastic integrals and adjoint multitime 
stochastic Pfaff systems. Thirdly, we formulate and we prove a multi- 
time maximum principle for optimal control problems based on stochastic 
curvilinear integral actions subject to multitime Ito-Udriste process con- 
straints. Our theory requires the Lagrangian and the Hamiltonian as 
stochastic 1-forms. 
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tial system, path independence, multitime It6-Udri§te product formula, adjoint 
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1 Introduction 

The subject of this paper risen from the intersections of basic ideas in our works 
[T5] - [20] and those well known as stochastic literature [T] - [TT] , [21] - [25] . The 
principal aim is to solve stochastic optimal control problems based on curvilinear 
functionals as actions and stochastic differential systems as constraints. In this 
paper we describe how the concepts, methods and results in [12] - [20] can be 
applied to give a rigorous multitime stochastic model. 
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There are several reasons why one should learn more about multitime Wiener 
process, Ito curvilinear stochastic integrals, multitime stochastic differential sys- 
tems, complete integrability conditions, path independent stochastic curvilinear 
integral, path independent stochastic processes, multitime Ito-Udriste product 
formula and adjoint stochastic multitime Pfaff systems, optimization problems 
with curvilinear stochastic integral functionals, and multitime stochastic maxi- 
mum principle. They have a wide range of applications outside mathematics (for 
example, can be applied to give a rigorous mathematical models in Finance), 
there are many fruitful connections to other mathematical disciplines and these 
subjects will give a rapidly developing life of its own as a fascinating research 
field with many interesting unanswered questions. 

In Section[2]we present a brief introduction in the theory of multitime Wiener 
processes (e.g., [7]). We outline in Section [3] how the introduction of stochastic 
curvilinear integrals in the Cairoli- Walsh sense leads to a simple, intuitive and 
useful understanding of multitime integration process. In Section 0] we define 
and study the stochastic curvilinear integrals in our sense. In Section [5] we 
study the complete integrable multitime stochastic differential systems, the path 
independent stochastic curvilinear integral, and the multitime stochastic path 
independent models. Section [5] contains original results regarding the multitime 
It6-Udri§te product formula and the adjoint stochastic multitime Pfaff systems 
and multitime stochastic first integrals. The stochastic control problems with 
curvilinear stochastic integral functionals constrained by multitime stochastic 
differential systems are formulated and solved in the Section [7J In this context 
we have obtained a stochastic multitime maximum principle. 

2 Multitime Wiener process 

Let t — {t a ) a= Y^ G P+ be a multi-parameter of evolution or multitime and 
let r^oT C R™ be the parallelepiped fixed by the diagonal opposite points = 
(0, 0) and T = (T 1 , T m ) , equivalent to the closed interval < t < T, via 
the product order on P™, defined by 

(t\, tT ) <(<) (4,*2,...,t2*) if ti <(<)*a, ^ all a = T>. 

Let (fi, J- ', P) be a probability space endowed with a complete, increasing 
and right- continuous filtration (a complete natural history) {(J- t ) t : t s ^ot}- 
Such a probability space (fi, T, {Ft) t£Q-0T , P) is called filtred probability space. 
Let / be any subset of {l,...,m} and let us denote by T t (I) the a— algebra 
generated by the a— algebras J^j, where t a < t a , for all a a I. We say that 
the filtration satisfies the conditional independence property if for all bounded 
random variables X, all t e PJ™ and / C J C {1, m}, 

E [X | T t (J)} = E [E [X | T t (J)} | T t (J \ /)] . (2.1) 

This property implies that the conditional expectations with respect to T t (J) 
and T t (J \ I) commute. 
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For a multitime process x = (x (i, w)) tg Q or , the increment of x on an interval 
{ti,t 2 ] C tt T, is given by (3, pp. 10]) 

2 2 m 

i((ti,*2])= E E (-l)" 1 ^^^!),-,^))- (2.2) 

i(l)=l i{m) = l 

For simplicity, here and in the whole paper, we will denote by £ t the random 
variable £ (i, w) at each multitime t. 

Definition 2.1 (Martingale) Let x — (xt) te Q &e a multitime Tt — adapted 
process. 

(i) The process x is called weak martingale if E [x ((t, s]) | .Ft] = 0, /or aZZ 
(,se Ry, swc/i i/iai t < s. 

(ii) The process x is called martingale if E [x s \ Ft] = Xt, for all t, s G M"\ 
such that t < s. 

Clearly, every martingale is a weak martingale [3J. 

Definition 2.2 A multitime, real-valued, and right- continuous process A = 
[At : t S R+) is said to be increasing if A t — P— a.s. /or i € R+ and i/ 
^4 ((*, s]) > 0, for all subintervals (i, s] C R+ (see (MM )- 

Theorem 2.3 ([3, Prop. 8, pp. 41]) If x is a squared-integrable martingale, 
then there exists an increasing process (A t ) such that (x 2 — At) is a weak mar- 
tingale. 

Theorem 2.4 ([3, Prop. 8, pp. 41]) Let x be a strong continuous martin- 
gale such that E[|xt| 4 ] < oo. Then there exists an increasing J- t — previsible 
process [x] t such that \x\ — [x] t ) is a martingale. 

Let B be the Borel a— field of R™ and let v denote the Lebesgue measure. 
For t = (i 1 ,...,*™), set Q t = [0,* 1 ] x [0,i 2 ] x ... x [0,t m ] and 

w(t) = w(t\...,t m ) = w(n ot ). 

This defines a multitime mean-zero Gaussian process [7j Ch. 5] W — W (t) t€(l 
with covariance 

m 

E [W tl W t2 } = v ( [0, ii] n [0, i a ] ) = J] min {if , £ } . 

Definition 2.5 v4 stochastic process of the form (Wt '■ t G R™) is called multi- 
time Wiener process (starting at zero) or Brownian sheet if Wo = and i/ Wt 
is a gaussian process with E [Wt] = and /or t\ = (tf ) a= Ym> ^ 2 ~ (^2 )a=Tm> 

m 

E[W tl Wi 2 ] = IJmin {<?,£}. 

ct=l 
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Definition 2.6 The multitime stochastic process (Wt : t G Oot) *s called a Tf 
Wiener process if, in addition, E[W S | F t ] = W t , for all t,s e R™, such that 
t < s. 

A first example of martingale is the multitime Wiener process. 

Hypothesis right-left (RL) Suppose a sample sheet x : Oot — > K is 
continuous from the right and bounded from the left at every point. That is, 
for every t G Oot, t | to, implies x (t) — > x (to) and for t t to, lim t ^ to x(t) 
exists, but need not be x (to)- We use only stochastic processes x where almost 
all sample sheets have the RL property. 



3 Stochastic curvilinear integrals in 
the Cairoli- Walsh sense 

Let F be an oriented piecewise C 1 curve in Rip given by parametric repre- 
sentation t = 7(Y), r G [0,1]. The curve T of the parametric representation 
t = 7(r) = 7(1 — t), t e [0, 1] has opposite orientation. 

Definition 3.1 A piecewise C 1 curve is called of pure type if each component 

d'y 

of the tangent vector field — preserves its sign. 

dr 

Given a process W = W (t) ten and a pure type curve T, we can define 
m processes W^, ct = l,m, on V, which may be thought of as coming from 
increments in the direction of each Ox a axis. A suggestive notation for this 
would be dWl = d a W. 

d^ a 

If — — (t) > 0, i.e., the component 7" is nondecreasing function and if 
dr 

7(0) = to and t — 7(0-) <G T, then we introduce the subset 

D? = {se R™ \t^<s a <t a , < s? < 7 /3 (r),/3 ^ a, < r < a}. 

For a squared-integrable martingale W and a curve T of pure type joining the 

dj a 

initial point to and the final point tf, with — — (r) > 0, we define W^(tr) = 

dr 

W(D? f ) and Wl(t) = E{W(D? f ) \ Jf}, t G T. Then each W v a = {W%(t), , t G 
r} is a one-parameter square-integrable martingale. Consequently, one can de- 
fine the ltd curvilinear integral of a process </> = {</> (t) : t G ^ot} with respect 
to W„, in the usual way, and denote it by 

J^(t) d a W. 

dj" 

If the component a of the tangent vector field satisfy the condition — — (r) < 
(nonincreasing function), then we define 

J 4>{t) d a w = -Jj>{t) d a w. 
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Finally, if T is of pure type curve, we let 



4 Stochastic curvilinear integrals in 
the It6-Udri§te sense 

In our theory we need a curve 

7 : [0, 1] — ► O 0T C IR™, t = t (r) , r € [0, 1] , (4.1) 

where r is the curvilinear abscissa. The curve 7 is called increasing if 

7 (r) < 7(t0 in tt™, if r < r in [0, 1]. 

The curve 7 is called piecewise C 1 if there exists a curve 7' : [0, 1] — > Qqt with 
finitely many discontinuities, satisfying the (RL) hypotheses, so that 

7 (r) = f V(A)dA, Vre [0,1]. 



Let i = (t 1 , ...,t m ) <E ^oT- Let (Wt) t£fl be a multitime Wiener process. 
Then ([1 Th. 3, pp. 45]) W 2 decomposes into the sum of a weak martingale 
and an increasing process (see Definition 12.11 and Definition 12. 2p . According to 
Dozzi ([31 Lemma 6, pp. 151]), the increasing process associated with (W t ) te0or 
is denoted by (W) t — t 1 ^ ...t m and it means that for h = [h 1 , /i m ), we have 



E 



w?+h - n (*° + ha ) 1 * 



w t 2 - n t a - 



In other words, for the multitime t = ft 1 , ...,t m ) £ f^or, the stochastic process 



ten 



is a (continuous) martingale. This leads to the construction of stochastic curvi- 
linear integral with respect to W. The case m = 2 was explicitly given in [21 §7, 
pp. 157]. 



Definition 4.1 Let cj> = {<f>(t) : t S ^ot} &e a rea/ J- t —predictible process, such 
that 

<t>l d(W) t ■ x. 



E 



(4.2) 
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Let 7ot be a C 1 increasing curve. The real number 



H4>) 



70T 



<j)(t)dW t = / 0( 7 (r))dfl T 



(4.3) 



is called the stochastic curvilinear integral of the process <fi = {<f> (t) : t G ^ot} 

def 

along the curve 7 with respect to \Wt)teCi 0T > where B T = W^( T \ is stochastic 
processes normal distributited of mean and variance uoZ(Oo 7 ( T )). 

For m = 2, see [2J. 

Definition 4.2 Let <j) = |(</> a {t)) a =Td, : ^ ^ ^ot| be an Tt—predictible process 
with values in M. d . Let 7o ^ be a C 1 increasing curve. The real number 



1(4) 



a (t)dW t a = / o ( 7 (r))dfl? 



(4.4) 



(i.e., a sum of ltd classical integrals) is called the stochastic curvilinear integral 
of process <p = ^(4> a (t)) a =Td\> a ^ on 9 the curve 7 with respect to the Wiener 

def 

process W = {Wt) a =Tdt where = W®, T y for each a — l,d, is a stochastic 
processes as in the above definition. 

Here and in the whole article, for any given Euclidean space H , we denote 
by (•,•) (resp. ||-||) the inner product (resp. norm) of H. Also, we use Einstein 
summation convention. 



Remark 4.3 With the previous definition {4-$ ; we have, by Ito's isometry 
property 



E 



E 



E 



HiH^f^it 1 {r)...t m {r))dr 



Lo 



A particular case (n — 1, m — 2) of the previous formula is proved in [2]. It 
is obvious that E [I (0)] = 0. 



5 Multitime stochastic differential systems 

Let us change the single-time approach of stochastic theory (see, for example 
0) to a new approach issuing from the papers of the first author. We use 
a multitime parameter of evolution t — (i 1 , t™ 1 ) £ f^or and we introduce 
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the multitime stochastic differential systems (mSDS). For that, let f(t,xt) 
= {fa (ti x t)) i=Tn be an n x to matrix of previsible processes with [3j pp. 73] 

a — l.m 



E 



|/(s(r),a; s ( T ))|| dr 



Tot 



< oo for all t S fioT, 



where r is the curvilinear abscissa on 704, let g(t,x t ) — [g % a (t, xt))i=TTi be an 

a— l,d 

n x d matrix of previsible processes, such that 

\\g(s,x s ) l^dis 1 ...s m ) < 00 for all t € f2 T, 

7ot 

and let W = (W t a ) t , a = 1, d, be a multitime Wiener process with values in R d . 



Definition 5.1 Let i = 1, n, a = l,m and a = l,d. XTie multitime stochastic 
differential system 

dx\ = /j (t, x t ) + 5 * (t, a; t ) d^ a , * g n 0T (5.1) 

is called ltd - Pfaff stochastic system. 

The coefficients f a (t,Xt) are called dr«/i coefficients and g l a (t,xt) are the 
diffusion coefficients. 

Definition 5.2 ^4 multitime stochastic differential system is called completely 
integrable if there exists an m-sheet x(t) satisfying the stochastic integral relation 

x l (t) = x l (0) + [ f a (s 7 x s )ds a + [ gl(s,x s )dW:, ten 0Tl 

J 70* J lot 

independent of the selection of the C 1 increasing curve 70* . 

Thus, the right hand side of an ltd - Pfaff stochastic system is well-defined 
as a stochastic curvilinear integral, under suitable assumptions on the functions 
ft and g\. 

The first integral can be interpreted as an ordinary curvilinear integral. The 
second integral, i.e., the stochastic curvilinear integral, cannot be treated as 
such, since the sheet-wise Wt is nowhere differentiable. Of course, the complete 
integrability conditions for the first curvilinear integral are contained in the 
classical books while, for the stochastic curvilinear integral, only partial results 
can be found in [2], [3]. 

If a multitime Ito - Pfaff stochastic differential system is not completely 
integrable, given the increasing C 1 curve 7 0i : s a — s a (r), re [0,r ], s(0) = 0, 
a curve x(t) which satisfies 

x\r) = x*(0) + £ f a (»(A), 1(A)) ^dA + £ g\ ( S (A), x(X)) dB a x 

is called solution. 

Having in mind some ideas in [2], [3], completing with our ideas, let us praise 
a fundamental path independent stochastic curvilinear integral. 
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5.1 Path independent stochastic curvilinear integral 

Here is for the first time when is presented a curvilinear stochastic integral 
independent of the path. 



Theorem 5.3 Let jot be an increasing curve in f^oT- The stochastic curvilinear 
integral (primitive) J W s dW s has the value Wt ~ W ° — | i 1 • • • t m . It can be 
written as 

V 2 = V 2 + \ f dis 1 ■ ■ ■ s m ) + f W s dW s . 

z z z J lot J lot 

Obviously, Wq = and the stochastic curvilinear integral f W s dW s is path 
independent. 

Remark 5.4 Our point of view requires the volume written as a special curvi- 
linear integral, 

dis 1 ■ ■ ■ s m ) = vol(fl t), [ dir 1 ■ ■ ■ r m ) = vol{Cl ot ) - vol(Sl 0s ), s < t. 

Proof (Ionel Tevy) For simplicity, we refer to m = 2. Let M. be the 
random measure in R+ which assigns to each Borel set A a Gaussian random 
variable of mean zero and variance /x(-A), where /i is Lebesgue measure and 
which assigns independent random variables to disjoint sets. 

Define a process (W(z) : z G R\) by W(z) = W(Qoz), where £l 0z is the 
rectangle whose lower left hand corner is the origin O(0, 0) and whose upper 
right hand corner is z = (s,t). The process (W(z) : z <G R+) is called a two- 
parameter Wiener process. 

For zi(si,ti) and z 2 (s2,*2) with z\ < z 2l note L ZlZ2 = fl 0z2 \ Qo Zl - Let 
[a, b] x [c, d] be a rectangle in R+, and let 

P n = {a = s% < s ? < ... < C B = b}, Q n = {c = t%<t n 1 < ... < C n = d} 

be partitions of the segment [a, b] and, respectively, [c, d] with \P n \ — > 0, 
\Q n \ — > as n — > oo. Let us denote a = (a, c), f3 — (o, d), z% = (s£,i£), 
k = 1, m n . Then 



\L n \ — max \ area \ L z ^ z ^ +1 j) — > as n — > oo. 
Lemma 5.5 (Quadratic variation) The limit 

m n — 1 

£ (W " W (z fc ")) 2 — > area (L aj9 ) , 

fc=0 

as n — > oo, holds in L 2 . 
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Proof. Set 



Then 



Rn= £ ( w ( z Ui)-w(z%)y 



k=0 



m n — l 



R n -area(L aP )= g [(W (z^ +1 ) ~ W (zl)) 2 - area (l z 
Denoting, 



= (W - W (z,")) 2 - area 



we find 



E 



m n — 1 



(R n - area (L al3 )) 2 = £ E(pfePj)- 

fe=0,j=0 



For k ^ j, the term in the double sum equals 0, according to the independent 
increments, as W(v) — W(u) and A/"(0, area (L uv j). Hence 



E 



where 



if In 

(R n - area (£ Q/3 )) 2 ] £ E [(if - l) 2 [area [L v 

k=0 

W(z% +1 )-W(z%) 



Yk = Y£ = 



'Area (i 2 », f+1 ) 

is a Gaussian process A/"(0, 1). Therefore, for some constant C, we have 



E 



m n — i 

(R n - area {L afj )) 2 <C ^ \area (yL z n z n + ^j 



< 



fc=0 



< C \L n \ area (L a p) — > 0, as n — > oo. 

■ 

Let r™ = {0 < zi < ... < z mn = z} be a partition of the curve 7o z , 
i.e., z%(s%,t%) £ 7o z , and |r™| = maxj. aria (Q z ™ +1 \^z™)- Note, according ltd 
definition, 

m n — 1 



fc=0 



Then, we have 



W 2 {z) 1 



m-n, — 1 

£ E (^+i)"^)) 2 - 



fc=o 
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When |r n | — >■ 0, as n — > oo, based on the foregoing Lemma, we find 



E (^+i)- w (**)) 2 ->«* 



in i 2 , as n — » oo, and the result is established. 

The following examples are based on the complete integrability notion for 
the stochastic curvilinear integrals and on Itd-Udri§te stochastic calculus rules 



for any a, b = l,d;a,/3 = l,m, where S ab is the Kronecker symbol, c a (t) — 
-[fiait 1 ■ ■ -t m ) and the tensorial product S ab c a (t) represents the correlation co- 
efficients. 

5.2 Examples of path independent processes 

1) Stock prices. The idea to reconsider applications in Finance via the mul- 
titime stochastic calculus was inspired by the work given in [5]. Let (P t ) (eR ^ 
denote the price of a stock at two-time t = (t , t 2 ) € M+, where t 1 means time 
and t 2 represents a "space" variable (as example, showing the price evolution as 
function of the distance between supplier and seller) . In this way, the stochastic 
perturbations involved in price dynamics are modelled by a two-time (time- 
space) Brownian sheet. We model the evolution of the price Pt supposing that 
the relative change in price P t is involved in the SDE 



for constant drift vector \i a > and constant diffusion vector o~ a . Hence 

dP t = P t fi a dt a + P t a a dW a . 
Using Ito-Udriste formula 



dW? dW\ = 



5 ab c a (t)dt a ,dW t a dt a = dt a dWf = 0, dt a dt fi = 



— - = fi a dt a + a a dW a , 



Pt 




Ma - -<T a <rp8 af, c x (t)\ dt x + a a dW a , 



we find 



The price Pt is always positive, if po > 0. Since 




and E f P s a a dW a = 0, we find 




lot 
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Hence 

E{Pt] = Poe^ , t a >0. 

This expected value of the stock price is the same with the deterministic solution 
of the completely integrable Pfaff equation 

dP t = Ptv a dt a . 

2) Let t=(i 1 ,( 2 )el|,iel and g a : R\ -»■ E, a = 1, 2 be two continuous 
functions. Let ci(t) = i 2 , c 2 (i) = i 1 and 7ot be an increasing curve in £1 t- The 
unique solution of the stochastic differential equation dx t = x t g a (t)dW" , x(0) = 
1 is . 

if the (usual and stochastic) curvilinear integrals are path independent, i.e., 
g a (t) — ha^t 2 ). To verify the solution, we note that the stochastic process 

Vt = -\ [ g a (s)gp(s)6 af3 c x (s)ds x + f 9a (s)dW? 

J~fot J Jot 

satishes 

dyt = -\g a {t)g p {t)5^c x {t)dt x +g a (t)dW t a . 

Applying the It6-Udri§te Lemma for u(x) — e x , we obtain 

du 1 d^u 

dx t = —dy t + g a (t)gp(t)8 afi 'c x (t)dt x 

= e yt ^-lg a (t)g p (t)S^c x (t)dt x + g a (t)dW t a + ^g a (t)g p (t)S afj c x (t)dt x 
and hence 

dx t = x t g a {t)dW?. 

3) The formula 

\w? = \wl + \( dis 1 ■ ■ ■ s m ) + f W s dW s . 

Z Z Z J lot J lot 

and the notations x t — \W 2 , u{t) = \,v{t) = W t motivate the following 
Definition 5.6 A completely integrable stochastic process xt of the form 

x t =x + / u(s, lj) d(s 1 ■ ■ ■ s m ) + / v(s,uj)dW s , 

•'lot •'lot 

where u(t), v(t) satisfy the integrability conditions 



3 /" \u{s)\ \\c(s)\\d<T < 00, E f v 2 {s)d{s 1 •••s m ) < 00, 

J-fot J~fat 



is called a volumetric stochastic process. 
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The volumetric stochastic process can be written also as a stochastic Pfaff 
equation 

dx t =u(t)d(t 1 ■■■t m ) + v(t) dW t . 
To motivate the adjective "volumetric" we need the following 

Lemma 5.7 The curvilinear integrals 

u(s,cj) d(s 1 ■ ■ ■ s m ) and I v(s,ui)dW s 



are path independent if and only if u(s, ui) = ^(s 1 ■ ■ ■ s m ,uj), respectively v{s, to) 
= ip(s ■ ■ • s m ,uj), i.e., the functions u and v depend on the point (s ,...,s m ) 
only through the product of components s 1 ■ ■ ■ s m . 

Proof. The first curvilinear integral is path independent if and only if 

d d 
g^(u(s)c a (s)) = — («(a)c/j(s)). 



Since 



it follows 



dc a dcp 
5^ (S) = ^ (S) ' 

" U (s)c a (s) = ^(s)cp(s), 



i.e., u(s) — (^(s 1 • • • s m ). 

As was shown by Cairoli and Walsh [2J, the (second) stochastic curvilinear 
integral is path independent if and only if v(s) = ^{s 1 ■ ■ ■ s m ). ■ 

In the following theorem we state a formula which is very useful for comput- 
ing curvilinear Ito integrals. It can be thought as the fundamental theorem of 
multitime stochastic calculus. 

Theorem 5.8 Let x t , t — (t , ...,t m ) € i?™ be a volumetric stochastic process, 
i.e., 

dx t = u(t) dit 1 ■ ■ ■ t m ) + v{t) dW t . 

If g(t,x) is a C 2 function, then the stochastic process y t = g(t,x t ) is completely 
integrable, with 

dVt = §^^ Xt ^ dta + |f + l^(^ x t)(dx t ) 2 , 

where for computing (dx t ) 2 we use the following formal rules \12] 

dW t dW t = d(f ■■■t m )= c x {t) dt x , dW t dt a = dt a dW t = 0, dt a dt p = 0. 



12 



Explicitly, 

=)2. 



+^(t,x t )v(t)dW t . 
In terms of curvilinear integrals it reads as follows 

g(t,x t ) = g{0,x ) 

+ f ^(s,x s )v(s)dW s . 

J Jot ° X 

4) Integration by parts Let 704 be an increasing curve in Oot- If g{t, x) = 
(t 1 ■ ■ ■ t m ) x, then the stochastic process yt = git, Xt) satisfies 

dy t = x t d(t 1 ---t m ) + {t 1 ---t m )dx t . 
Replacing x t = W t , we find the " integration by parts" formula 

it 1 ■ ■ ■ t m ) W t = f W s dis 1 ■ ■ ■ s m ) + f is 1 ■■■s m )dW s . 

J Jot J Jot 

Generally, if g{t, x) — (pit) x, where ip(t) is continuous and of bounded vari- 
ation in [0,f], then the stochastic process y t = g{t,x t ) satisfies 

dy t = x t dip(t) + pit) dx t . 

Replacing x t — W t , we find the integration by parts formula 

<p(t)W t = [ W a d<p(s)+ f (pis)dW s . 

J Jot Jjot 

5) Geometric Brownian Sheet It is a stochastic process of the form 

s t = e ^ ta+aB \ t = it\...,t m ) e n 0T c Rip, 

where \i — (fj, a ) € R m , a > and (5 t ) tG Q or is a standard multitime Wiener 
process. Since St = f(t,B t ), for f(t,x) = e ^ a * a+ °' x and 

df__ f d£ _ , _ , 2 

the Ito-Udriste formula shows that the geometric Brownian sheet is a solution 
of the multitime stochastic Pfaff equation 

dS t = aS t dB t + StV* dt a + l -o 2 S t dit 1 ■ ■ ■ t m ). 
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Definition 5.9 (i) Let x(t,uj) be an m-sheet solution of \5.1\) . t G Hqt, uj E CI. 
Sheetwise uniqueness of x (•, uj) means that ifx{-,u) : SIqt — * R™ *s ako an m- 
sheet solution of \5.1\) . on the filtered probability space endowed with the same 
Wiener process and initial random variable, then 

P [x (t, oj) = x (t, u) , yt g fior] = 1. 

(nj Let x (■,(*)) be a curve solution of i5.1\) with w G CI. Pathwise uniqueness 
of x(-,(jj) means that ifx(-,ui) is also a curve solution of i5.1\) . on the filtered 
probability space endowed with the same Wiener process and initial random vari- 
able, then 

P [x(t,u) = x(t,cj),Vt g [0,t q ]] = 1. 

6 Multitime Ito - Udri§te product formula and 
adjoint stochastic multitime Pfaff systems 

Let fioT be the parallelepiped fixed by the diagonal opposite points = (0, 0) 
and T = [T l , T m ) and t G CIqt be the multitime. Given a filtred probability 
space (fi, J 7 , (-7"t) te n T satisfying the usual conditions, on which a Wiener 
process W(-,oj) with values in M. d is defined, consider a controlled multitime 
stochastic differential system 

J dx\ = [i l a (t, x t , u t ) dt a + a\ (t, x t ,u t ) dW? , (f . 1 ^ 

\ i(0) = «G M", 

where 

/i(-,a:(-,w),u (•><")) = (m!) :!JotxM"xC/ 

^(-, a: (■,«), «(-,a;)) = (<) : ft 0T x R" x U 

and, for simplicity, we denote x(t,ui), respectively u{t,u), by Xt and u t . Here, 
u t G C/ G K fe is a parameter whose value we can choose in the given Borel 
set U at any instant multitime t in order to control the process Xt- Thus, 
u t = u (t, lu) is a stochastic process, called control (vector- valued) variable or, 
simplified, control. Since our decision at multitime t must be based upon what 
has happened up to multitime t, the function cj — > u (t, uj) must (at least) be 
measurable w.r.t. T t , i.e. the process u t must be J- t — adapted. We also assume 
that u (t, ui) is satisfying RL hypothesis. In addition we require that u (i, to) 
gives rise to a unique solution x (t) = x^ (t) of (|6.ip for t G CIqt, i-e., the 
system (|6.1[) is completely integrable. Let us denote by A the set of all controls 
with the above properties. Any u (-, uf) G A is called also a feasible control. 

Definition 6.1 Let [ci,J-, (J 7 t)teM. + ^ e 9^ ven satisfying the usual conditions 
and let W (t) be a given standard (^ r t) tgR — Wiener process with values in M. d . 
A control u(-,Ui) is called admissible, and the pair (x (• , oS) , u (• , u))) is called 
admissible, if 



vnxd 
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1. u E A; 



2. x(-,u) is the unique solution of system h6.1\) : 

3. some additional convex constraint on the terminal state variable are sat- 
isfied, e.g. 

x(T,oj) e K, 
where K is a given nonempty convex subset in W 1 . 

The set of all admissible controls is denoted by A a d- We assume: 

(HI) fi l a , a al and f a are continuous in their arguments and continuously 

differentiable in (x, u), for every i = 1, n, a = l,m, a = 1, d; 

(H2) the derivatives of fj, l a and o~ l a in (x,u) are bounded for every i = l,n, 

a = 1, m, a = 1, d; 

(H3) the derivatives of f a in (x,u) are bounded by C (1 + |x| + \u\), for 
every a = l,m and the derivative of "J in x is bounded by C (1 + |a:|). 

Then, for a given u (•, u>) £ A a d, there exists a unique solution a; (■, oj) which 
solves the system (|6.1[) . 

6.1 Multitime Ito - Udri§te product formula 

In order to prove the multitime stochastic maximum principle using the ideas 
rising from the papers [12], [14], [16], [17], we need the following auxiliary re- 
sult, which is a special case of the multitime Ito - Udri§te formulas [12]. The 
theory covers both the problems formulated with complete integrable stochastic 
systems and problems based on nonintegrable systems. 

Lemma 6.2 (Ito - Udriste product formula) Suppose the ltd process ( x t)ten T ' 
i = l,n is solution of the multitime stochastic Pfaff system 

f dx\ = (t, x (t, u) , u (t, w)) dt a + a l a (t, x (t, u) , u (t, «)) dW t a , 
\ x(0,uj) = x E R n , 

and the ltd process (pi (t)) t& Q , i = 1, n is solution of the multitime stochastic 
Pfaff system 

( dpi (t) = a ia (t, x (t, u)) , u (t, oj)) dt a + q ia (t, x (t, uj) , u (t, w)) dWf, 

{ P (0, w )^er, 

where the coefficients in both evolutions are predictable processes and u(-,uj) is 
an admissible control. Then the interior product pi{t)x l (t) is an multitime ltd 
process and 

d ( Pi (t) x l (t)) - Pl dx l + x'dpi + q lb a l a 5 ab c a {t)dt a . 

This equality can be called the stochastic differentiation formula for the interior 
product. 
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6.2 Adjoint multitime stochastic Pfaff systems 

For simplicity, we will omit u> as argument of processes. 

Definition 6.3 (Variational multitime stochastic Pfaff system) Let u(-,ui) be 
an admissible control. Let 

dx\ = /4 (t,x t ,u t )dt a +< (t,x t ,u t )dW t a 

be a multitime stochastic Pfaff evolution. The multitime stochastic system 

dCt = (ML* (*> xt,u t ) dt a + a l axJ (t, x u u t ) dW t a ) e (t, u) (6.2) 

is called stochastic variational multitime Pfaff system with control u (•, uS). 

Definition 6.4 (Adjoint multitime stochastic Pfaff system) Consider a multi- 
time stochastic Pfaff evolution as in i6.2\) . A linear multitime stochastic system 
of the form 

d Pj (*) = ( a aj ( f > x t ,u t ) dt a + q l bj (t, x t ,u t ) dW?) pi (t) , b = 1, d, i, j = 1, n 

is called adjoint multitime stochastic Pfaff system if the interior product pk (t) £ fe (t) 
is a global multitime stochastic first integral. 

Theorem 6.5 The multitime stochastic Pfaff system 

dpj (t,co) = [{-tf axi (t,x t ,u t ) + a l axk (t,x t ,u t )a^ xJ {t,x t ,u t ) S ab c a (t)) dt a - 

-cr l axl (t,x t7 ut)dW t a ] Pl (t,u) 

is the adjoint multitime stochastic Pfaff system with respect to the variational 
multitime stochastic Pfaff system. 

Proof. Let 

d Q = {^ ax o (t,x t ,u t )dt a +a l axJ {t,x t ,u t )dW t a )$, i,j =T~h~, 

be the variational stochastic multitime Pfaff system. Denote the adjoint multi- 
time stochastic Pfaff system by 

d Pj (t) = (aij (t, x u u t ) dt a + qlj (t, x t , ut) dW*) Pl (t) , i,j = T~n. 

We determine the coefficients a % a j and such that pk (t) £ fe (t) to be a multitime 
stochastic first integral, i.e., 

d(p k we w) = o, 

where d is the stochastic differential. Imposing the identity 
Pi (t) € (t) = Pl (0) C (0) , for any t6Q„ T , 
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or 

= d ( Pk (t) e, k (t)) = Pl (t) e (*) {^ ax3 (t, xt, ut) + a l aj (t, x t , «*) + 

+q* fe (t, a; t , «*) crL' (*. &t, «t) 5 Qb C tt (t))dt Q + 

+Pi (*) e (*) (<4* (t, x u u t ) + q% (t, x t ,u t )) dW t a , 

we obtain 

4j (*i &t, «t) = -/O (*> x *' w *) _ Safe (*) Otoi (*, as*. «t) ^ ab c Q (i), 

9aj (t,X t ,U t ) = -CT^ (t,X t ,U t ) . 



7 Optimization problems with 

stochastic curvilinear integral functionals 

Multitime stochastic optimal control problems with terminal conditions have 
some features: there is a multitime diffusion system, which is described by a 
multitime Ito - Pfaff stochastic differential system; there are some constraints 
that the decisions and/or the state are subject to; there is a criterion that 
measures the performance of the decisions. The goal is to optimize the crite- 
rion by selecting a nonanticipative decision among the ones satisfying all the 
constraints. 



7.1 Multitime stochastic maximum principle 

The idea to use curvilinear integrals in stochastic control theory is very recent 
|12j . [B]. Our paper |12) refers to multitime stochastic maximum principle, Ito 
- Udriste formulas and Hamilton- Jacobi-Bellman approach, while the paper [5J 
obtains a stochastic curvilinear integral via Hamilton- Jacobi-Bellman approach. 
Also, some geometrical methods used in the single-time stochastic theory (see 
[5]), can be extended to multitime stochastic techniques. 

The cost functionals of stochastic economical and/or mechanical work type 
are very important for applications. This motivates to solve the multitime 
stochastic optimal control problem 



max 
«(•) 



f a (t,x t ,u t )dt a + (2») 



(7.1) 



subject to a multitime Ito process constraint 

dx\ = nl(t,x t ,u t )dt a +al(t,xt,u t )dW t a , x(0) = x , x(T)=x T , (7.2) 

where xt = {%t)i=Tn 1S ^ ne multitime state variable, u(t) £ U, Vf £ Oqt is 
the multitime closed-loop control variable, Wt = (Wj 1 , Wf) is a standard 
multitime Wiener process. 
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The problem (|7.1l) - (|7.2p can often be handled by applying a kind of "La- 
grange multiplier" method, as in holonomic and nonholonomic approach of 
deterministic case |16j . respectively, [17] . The stochastic running cost rj = 
f a (t,xt,u t ) dt a , a = l,m is a stochastic Lagrangian I— form. We introduce 
the stochastic Lagrange multiplier Pi {t,u) € L 1 ^ {Hot, K") , i — l,n, where 

(OoT) R n ) is the space of all M™— valued adapted processes (<frt) te n 0T such 
that 

|0(s(t),2: s ( t ))II dr 



< oo for all t £ flor, 



where r is the curvilinear abscissa on the increasing curve 70*, t £ £Iqt- To 
use geometrical methods in control theory, let us suppose {pi (£,w)) tgf2 as a 
multitime ltd process, i.e., 

dpi (t) = a ia (t, x t ,u t ) dt a + q la (t, x t ,u t ) dW", 
where [(a ia {t,Xt,u t )) teQoT \ i<i< n , respectively, [(q ia (t, x t , Wt)) te n 0T ] i<*<™ arc 

l<a<m l<a<(i 

matrices of previsible processes. The adjoint process (pi {t^))i = Yn * s required 



to be {Ft) 



ten„ 



-adapted, for any t £ flor- 



To solve the foregoing problem, we use the stochastic Lagrangian 1—form 
C{t,x t ,u t ,pt) = f a {t,x u u t )dt a 

+P l (t) [mL (t, x t , u t ) dt a + a{ {t, x t ,u t ) dW t a - dxl] . 

The foregoing multitime stochastic optimization problem, constrained by a 
contact distribution, with stochastic perturbations, (|7.1[) - (I7.2[) can be change 
into another free multitime stochastic optimization problem 



max E 



C (i, x t ,ut,pt) + * {x (T,cj)) 



(7.3) 



subject to 

p{t,u) £ V, Vt G n 0T , x{0,oj) =x £ R n , 

where the set V will be defined as the set of adjoint multitime stochastic pro- 
cesses in an appropriate context. The problem (|7.3I) can be rewritten as 



max E 

u(-,ui)eA ad 



Vl (t) oj {t,xt,u t )dW? ■ 

7ot J Jot 

subject to 
p {t, w) £ V , Vt £ SIqt, x (0, uS) = x £ 



[f a (*, x t ,u t ) + Pi (t) Ha (*, * Q (7-4) 

ft (t) dii + *(a: (T,w))|, 

i = 1, n. 

Due to properties of stochastic curvilinear integrals (Remark [43]), the terms 
containing dW f a vanish. Evaluating j l0T Pi (t,w) dx\, via multitime stochastic 
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integration by parts, it appears the control Hamiltonian multitime stochastic 
1—form 

H (t,X t ,U t ,Pt) = (fa (t,X t ,U t ) + Pi (t) H l a (t,X t ,U t ) 

-Pi (*) °ii b (*, x t ,ut) el (t, xt,ut) 5 ab c a (t)) dt a . 
It verifies a modified multitime stochastic Legendrian duality, i.e., 

H = C+p t (t)dx l t - Pl (t)a axJ (t,x t ,u t )al(t,x t ,u t )5 ab c a (t)dt a 
-Pi (i) < (t,x t ,u t )dW t a . 

The key point to the derivation of the necessary conditions of optimal- 
ly is that the multitime Legendre stochastic transformation of the multitime 
Lagrangian stochastic 1-form to be minimized into a multitime Hamiltonian 
stochastic 1-form converts a functional minimization problem into a static op- 
timization problem on the 1-form TL (t, Xt, Ut,Pt)- 

Theorem 7.1 (Stochastic maximum principle) We assume the conditions 
HI — HZ. Suppose that the problem of maximizing the functional |7. lty con- 
strained by J7.£| ) over A a d has an interior optimal solution u* (t) , which deter- 
mines the multitime stochastic optimal evolution x (t). LetTL be the Hamiltonian 
multitime stochastic 1—form. Then there exists an adapted process (p (t, ^)) tG n T 
( adjoint process ) satisfying: 

(i) the initial multitime stochastic differential system, 

dH 

dx l (t) = —{t,x t ,u$,pt)+o-i xj (t,x t ,u* t )crl(t,x t ,u* t )S ab c a (t)dt a 
+<xi (t,x t ,u* t )dW t a ; 

(ii) the linear multitime stochastic adjoint system, 

d P i{t) = -H x i (t,x t ,u* t ,pt) -pj (t)a 3 axl (t,x t ,u*)dWt, 
p l (T) = (x T ) , i = T/n; 

(Hi) the critical point condition, 

H u e (t,x t ,u* t ,p t ) = 0, C=l,fc. 

Proof. In the whole this proof, we will omit ui as argument of processes. Sup- 
pose that there exists a continuous control u* (t, ui) over the admissible controls 
in A a d, which is an optimum point in the previous problem. Consider a variation 

u(t,e) = u* (t) +eh(t) , 

where, by hypothesis, h (t) is an arbitrary multitime stochastic process. Since 
u* (t, lu) £ Aad and a continuous function over a compact set £Iqt is bounded, 
there exists a number e n > such that 

u (t, e) = u* (t) + eh (t) 6 A a d, V |e| < e h . 
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This e is used in our variational arguments. 

Now, let us define the contact distribution with stochastic multitime pertur- 
bations, corresponding to the control variable u(t,s), i.e., 

dx l (t, e) = (4, (t, x (t, e) , u (t, e)) dt a + a\ (t, x (t, e) , u (t, e)) dW t a , 

for i = 1, n, or, 

x 1 (t,e) = x % (0,e) + / /4 (s,x (s,e) ,u (s,e)) ds" 

"/7ot 



+ / < (s, x (s, e) , u (s, e)) dW°, V* 6 ^ t, Vi = 1, n 

•'704 

and x (0, e) = xo G K n . For |e| < e^, we define the function 



J (e) = E 



/ Q (t, x (t, e) , u (t, e)) dt a + * (a (T, e)) 



70 T 



For any adapted process (j>t) te Q we have 

Pi (t) [Ma (*> s (*, e) . « (*, £)) ^ - dx* (t, s)] 



+ / Pi (*) < a; (i, e) , u (t, e)) dW t ° = 0, i = 1, n. 

J JOT 

To solve the forgoing constrained multitime stochastic optimization problem, 
we transform it into a free multitime stochastic optimization problem ([16]). 
For that, we use the Lagrange multitime stochastic 1-form which includes the 
variations 

C(t,x(t,e),u(t,e) ,p t ) = f a (t, x (t, e) , u (t, e)) dt a 

+Pi 0) [Ma (*) X (*! £ ) > U (*. £ )) + ^ (*i ^ (*) £ ) ) U (*! £ )) - (*) £ )] ) 

where i = 1, n. We have to optimize now the function 



J (e) = E 



£(t,aj(i,e),«(t,e),i)t) + *(a: (T,e)) 



V70T 



with doubt any constraints. If the control w* (£) is optimal, then 

J(e) < J(0), V|e| <e h . 

Explicitly, 

J (e) = E /" [/ a (t, z (t, e) , u (t, e)) + p % (t) (t, x (t, e) , u (t, e))] dt a 
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Pi (t, uj) dx l (t, uj, e) + * (x (T, e)) 



70T 



i = 1, n. 



To evaluate the integral 



Pi(t) dx z (t,e), 



70 T 



we integrate by parts, via Ito-Udriste product formula. Taking into account 
that (pi)t£Q 0T is a multitime Ito process, we obtain 

J(s) = E [ [f a (t, x (t, e) , u (t, e)) + p 4 (t) (*, & (*. e) . w (*i e))] 



Tot 



-E 



Pi(t) x l {t,e)\ - / x l (t,e) dpi(t) 



70 T 



+ Etf (a; (T,e)) 



Pj- (t) aL, (t, a: (i, e) , u (t, e)) a£ (t, z (t, e) , u (i, e)) 5 ab c Q cft a , 



with ct^ ; (t,x(t,e) ,u(t,e)) | e =o= cr^ x j (t,x t ,u t ), for all i,j = l,n and o = l,d 
and where 70T is a inverse image of the projection 7r o 70T = 7ot- Then, 



J (e) = E 



/ Q (t,x(t,e) ,u(t,e))dt a 



+E / [p i (*) / ij,(t,a:(t,e),u(i,e)) 



70 T 



Pi (t) a 3 , (t, x (t, e) , u (t, e)) ct£ (t, x (t, e) , u (t, e)) <5 ab c„] 



+E 



x l (t,e) dpi (t) - p t (t) x l (*,e)| 



70 T 



+ E* (x (T,e)) 



Differentiating with respect to e (and this is possible, because the derivative 
with respect to e, for e = 0, exists in mean square sense; see, for example |21j). 
it follows 



J' (e) = E / {[/ Qxfc (i, a; (t, e) , u (i, e)) + p 4 (t) (i, x (t, e) , u (t, e)) 



(*) ^L*** (*' 21 (*' £ ) ' u (*' £ )) °& (*' ^ (*> £ ) ' u (*' £ )) Sa{>Ca 
-Pi (t) a° axl (t, x (t, e) , u (t, e)) a\ xk (t, x {t, e) , u (t, e)) £ ab c Q ] di a + dp fc (t)} a;* 

+E / [/ au e (i, x (i, e) , u (t, e)) + p< (t) ^^„ c (t, x (t, e) , u (t, e)) 

J 70T 

-ft (*) (*« 1 (*» £ ) . u (*> £ )) CT b (*> * (*. £ ) 1 u (*> £ )) 5 ° bc « 
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- Pi (t) a J axi (t, x (t, e) , u (t, e)) (i, x (t, e) , u (t, e)) 6 ab c a ] h c (t) dt a 
+E^ X „ (x (T, e)) x k e (T, e) , c = T/k. 
Evaluating at £ = 0, we find 

J'(0) = E / {[f ax h (t,x t ,u t ) +pi (t)(J, l axk (t,x t ,u t ) 
Jj 0T 

-Pi (*) (*> x *' w «) (*> u *) (jai ' c «] dt " + d J>* (t)} x\ (t, 0) 

+E / [fan- {t,X t ,U* t ) +Pi (t)^ auC (t,Xt,Ut) 
~Pj (*) CT L%- (*' X *' U t ) CT b (*' X t> u t) 

- Pj (t) ai xi (t, x u u* t ) a\ uC (t, x t ,u* t ) 6 ab c a ] h c (t) dt a 

+E* X * (x (T)) x k £ (T) , c = TJe. 

where a; (t) is the multitime state variable corresponding to the optimal control 
u* (t). 

We need J' (0) = for all h{t) = (h c (t)) c=T1 ^. On the other hand, the 
functions x\ (t, 0) are involved in the Cauchy problem 

dx\ (t, 0) = (t, x (t, 0) , u (t, 0)) rft Q + (t, a; t , ««) dW t °) (t, 0) 

+ (i, x (t, 0) , u (t, 0)) di Q + < c (t, x t ,u t ) dW t b ) h c (t) , 

ten 0T , x e (0, 0) = e R" 

and hence they depend on /i (t) . The functions (t, 0) are eliminated by se- 
lecting V as the adjoint contact distribution 

dpk(t) = -[fax" (t,x t ,u t ) +Pi(t) n % axh (t,x t ,u t ) (7.5) 

~Pi ( f ) vixtx* (*' Xt > "*) °& (*> ^t: u *) <*° 6c a 
"Pi (*) (*' x t,ut) <?l x k (t, x t ,u t ) 6 ab c a ]dt a 
~a° axk {t,x t ,u t ) Pj (t) dW t a , 

for any multitime t £ JIot, with stochastic perturbations terminal value problem 

(see, e.g. [13]) 

p k (T) = f xk (x T ) , k — l,n. 

The relation (|7.5|) shows that 

a ia (t,x t ,u t ) = ~f ax k (t,x t ,u t ) - Pi(t) n l axk (t,x t ,u t ) 

+Pj (*) ""ax* (*> X *' U *) (*> X *' M *) c a]^ ab - 
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It follows 



dpi (t, w) 



H x i {t,x t ,u* t ,pt) -Pj (t) a J axl {t,x t ,u t )dW' t 



•a 
t J 



Wt € fioT ; i = 1, n, 



and 



H u c (t,x t ,Ut,pt) — 0, Vt S Oqt, for all c= l,fc. 



Moreover, 



dx 1 (i) 



— (t,x t ,u*,pt) + a l axj (t,x t ,ul)ai (t,x t ,ul) S ab c a dt 



.a 



•i 



+a l a {t,x t ,u*)dw t a , vt e n OT ,x(o) = x , Vi = 



Example (Deterministic problem, continuous two-time version, see 
[19] ) A mine owner must decide at what rate to extract a complex ore from 
his mine. He owns rights to the ore from two-time date = (0,0) to two-time 
date T = (T,T). A two-time date can be the pair (date, useful component 
frequency). At two-time date there is xo = (xq) ore in the ground, and the 
instantaneous stock of ore x(t) — (x l (t)) declines at the rate u(t) = (u l a (t)) 

the mine owner extracts it. The mine owner extracts ore at cost g» (t) an< ^ 
sells ore at a constant price p = {pi). He does not value the ore remaining in 
the ground at time T (there is no "scrap value"). He chooses the rate u(t) of 
extraction in two-time to maximize profits over the period of ownership with no 
two-time discounting. 

Stochastic model Since there must be some risk in the investment, the 
deterministic evolution -§^(t) — — u 7 (t) can be changed into a stochastic model. 
Hence, the manager want to maximizes the profit (curvilinear integral) 



where Wt = {Win') 1S a matrix Wiener process. Form the Hamiltonian 1-form 




subject to the stochastic law of evolution 




u 7 (t) + W t 




differentiate and write the equations 




'i— " — \i I 5^ dt a = 0, no sum after the index i; 
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m {<(ty 2 



dXAt) ~ — — — r = — qi a . dt a , no sum after the index i. 
ox 1 \ x l (t) J 

As the mine owner does not value the ore remaining at time T, we have Xi(T) = 
0. Using the above equations, it is easy to solve for the differential equations 
governing the control vector u(t) and the dual vector Xi(t): 

= Pi - Xi (t) , = - ft j no sum after t 

and using the initial and turn - T conditions, the equations can be solved nu- 
merically. 
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